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This model provides a structure for uniformly .eval- 
uating all operations of a school central office, where 
the assumption that those offices exist to provide ser- 
vices is tenable. 

s 

The model provides a mfeans for assessing the im- 
portance as well as the efficiency with which the tasks 
of central office operations are carried out. Forma- 
tive data is generated whic^ will assist in central 
operations planning. A summ^tive score, which reflects 
a sensitivity to both importance and task-achievement 
of a section, is generated. 

The model, compatible with MBO theory, has been 
piloted and is being field-tested for further develop- 
ment. 



i 



Art Empfrlcally Developed Model 
for evaluating the Central Office 
Opfrotions of a School System 

Don Carriker, Ph. D. 
Assistant Professor 



Don Carriker, Ph. 0. Director 

Office of Field Services and Research 

School of Education 

^10 Wick Street 

Youngstown State University 

Youngstown, Ohio 



OBJECTIVES 



Purpose ; 

The purpose of this project was to design and test an evaluation mode] which ^could 
be applied to school central office operations. The following objectives served as de- 
veloprrent parameters : The model will p rovide a means to 

1. Acquire data useful to the super i'ntendent and board of education in making decision? 
reLative to central offic^ operations. 

2. Acquire data useful to various directors and central office administrators in rede- 
fining and refining their operations. 

3. Explore more fully the relationships that exist between central office operations and 
the ongoing processes of the schools at the building level. 

Provide data useful for determining the extent to which certain operations of a school 
system should be centralized. 
5. Bring the accountability level of central office operations to a level commensurate 
with that which exists in other components of the system.' 

PERSPECTIVE 



School systems which have no centralized operations are rare. Many systems employ 
multiple assistant superintendents, directors, etc. who oversee wide-ranging programs and 
operations. Typically their work has been regarded as an input into the system. Field 
practitioners and others, however, may regard their efforts as outputs, in terms of 
services rendered. 

In designing this model It was ^assumed that all operations and offices in the cen- 
tral office exist to provide services which will in some way facilitate or enhance the 
acconpl ishnent of the primary mission of the school J This suggested two premises which 
were used in constructing this model: 

1. Those who work in the central office should be able to discuss their activities in 
these terms: 

1.1 As services rendered or made available to some reclpient(s) . 

1.2 What individuals or groups are those services intended for? 

2. A scale which would assess the quality of those services could validly be that of the 
perceptions of the user(s); with respect to: 

2.1 The importance of the service to the user. 

2.2 How well that service is being provMed or carried out. 

METHOD 

Developing the Instrument:^ 

A first step in conducting the evaluation provided by this model is that cf iden- 
tifying the various departments, offices, and operations sections which exist in the cen- 
tral office. Inasmuch as chis Is an operations assessment, not a personnel evaluation, 
the fact that one Individual or office may perform several roie^ is not germane. 



'''Services** were operationally defined as: "The performance of a task for the bene- 
fit of others, whether voluntarily, by request, or to fill a social need.** 

^An operations section, office, or department is said to exist af an entity when a 
clear mission, for which certain activities are being conducted, can be Identified and 
associated with that office, department, or operations section. 
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Information must then be gathered in t^.o areas of concern: 
■ 1 .^What, services are being provided and by ,/hom? 
2. For whom are those services Intended: 

This Information comes from those who staff iach office or section. Items can then be 
generated which have these characteristics; 

1. Each specifies, in operational terms, one and only one, service which is being offered 
by a given central office section or department. " ' 

2. Each service is identified as to its intended reci pi ent(s) . 

Each department or section \^ then given an opportunity to review those Items which 
pertain to .its services. This affords a check for item validFty and content coverage. 
The entire central office has then been defined as a set of services offered by a variety ' 
of separate divisions. This entire set of Items is then reorganized so as to be subsumed 
under the headings of user categories. A set of sub-scales, each keyed to a target-user 
population then exists. 

Administering the Instrument: 

Each population is th^^h administered a scale containing only those items which per- 
tain to services available, or used by, that population. For each item the respondent Is 
asked to make two responses in a forced-choice format: 

1. How important is this service to you In your relationship to the school system? 

2. How well is this service being provided or carried out? 

if ' 

analyzing the Data : ^ *' 

After administering the instruments the data derived from all populations is organ- 
ized so as to be under the heading of the section or office which perforrr-s the service. 
It may then be analyzed in several ways. Formative concerns may be addressed by calcul- 
ating a percentage value for each response on each item. Results are tabulated. A some- 
what more sophisticated statistic can be computed by constructing a 3X3 matrix, with col- 
umns headed "Considerable", "Moderate^', or "Little" (referring to responses on the im- 
portance dimension). Rows are headed "Good", "Average", or "Poor" according to the a- 
chievenent response categories. By calculating the percentage of responses occuring in 
each cell and summating those cells which represent acceptable importance/achievement 
combiaations a performance ratio can be obtained for, each item. 

A summative score, v-^hich represents the achievement of the entire department or 
office on all services can be generated. This score will be comparable across all offices 
in the central of f ice; ^making it possible to draw comparitive, norm-referenced inferences 
of 3 summative nature. This statistic, denoted "P"(Performance) is found by calculating 
the mean value of all spores for each response, on each item. This yields two mean re- 
spor^ses for each item; one denoted the mean value of Importance (l), and the other the 
mean value of Achievement (A). For each item a producf , lA, is computed and denoted as 
the item Evaluation (E) . The entire set of I values are then summated as are the entire 
s^t of E scores. These two summations are denoted ^1 and £E respectively. The overall 
performance (P) of the department, considering all services and their combined level of 
achievement/ importance is then represented by the one value obtained by evaluating this 
equation.-^ 

P(Performance) = 1^ ' 

2£l 

This /alue will range between zero and unity and may be considered to represent the ex- 
tent to which that department has approached the maximum possible performance level. 



The Rationale and derivation of this equation and procedure for its use are too 
lengthy to present In this draft* They are available and will be given by the presenter. 
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DATA S QUKCE . 

Developing the Model: 

This evaluation model was developed by six practitioners in the Shawnee Mission 
(Kansas) Public School system* Among them ./ere the viewpoints of an assistant super- 
intendent, a research specialist, a secondary principal, a central office director, a 
curriculum specialist, and an elementary principal. The model was designed to conform 
with existing MBO 'strategies and philosophy within the district. Statistical treat- 
ment of the data was suggested by methods used in existing program evaluations. 

Us ing the Mode} : 

The source of data for those using this model will be the populations who are speci- 
fied as users of central office services, and those who offer those services from the cen- 
tral office* In this project seven such user-populations were identified: building a4^ 
mi nis trators , teachers, commun i ty ( I nd i vi dua I s and groups), central office staff, and, 
others, Withln^ the central office thirty four discrete operations sections, offJces,^ 
or departments were identified. r 

RESULTS AND CONCLUSIONS 

The objectives of this evaluation project were substantially achieved. The Super- 
intendent and Board of Education were able to make several decisions In the domain of re- 
allocation of resources. The Directors and other central office aaministrators are in 
the process of res*tructur ing certain components of their operations* Although the third 
objective, being a process, is more resistant to measurement, it appears on the basis of 
intuition and observation that the process is in fact occurring. The final two objectives 
similarly; are not directly quantifiable, but the impression was that the project moved 
In the diiection suggested by objectives four and five* 

This evaluation model has been incorporated into the total managemervt processes of 
this school system and results will be-lTt i I ized in future decision making. 

IMPORTANCE OF THE PROJECT 



It appears likely that this model offers a promising entry point into evaluating a 
heretofore nebulous facet of school operations. Little previous effort has been made In 
this domain, while burgeoning accountability thrusts suggest that as many of the compon- 
ents of the educational system as can be evaluated should be evaluated. Where school 
systems are willing to place as many resources into central office evaluation as has 
typically been invested into teacher, staff, and program evaluation, the Shawnee MIsc'k . 
experience suggests that an Innovative change in philosophy and a new area for experi- 
mentation in educational accountability can be developed. 

Further developmental work Is being carried out and the model will likely bec<?me 
Increasingly robust. Others who are similarly interested are invited to make contri- 
butions to further this needed effort in evaluation. Certainly the thrust toward 
assessing the central office In operational terms deserves consideration. 
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